Add `assign-milestone` safe output for assigning issues to milestones by Copilot · Pull Request #4281 · github/gh-aw

Copilot · 2025-11-18T13:18:40Z

Implementation Complete: Assign-Milestone Safe Output

This PR adds a new "assign-milestone" safe output type that allows AI agents to assign issues to milestones with allowlist-based security.

Recent Changes

Fixed noop script bundling issue (commit addresses comment #3550893883)
- Moved noop.cjs from js.go (unbundled scripts) to scripts.go (bundled scripts)
- Added proper bundler configuration with getNoOpScript() function
- Removed duplicate getNoOpScript() function from noop.go
- Added assign_milestone to expected tools list in tests
- All 1040 JavaScript tests passing ✅
- All Go unit tests passing ✅
- All 81 workflows compiled successfully with 0 errors ✅

Configuration

The allowed field is mandatory and accepts either a string or array of milestone names/IDs:

safe-outputs:
  assign-milestone:
    allowed: ["v1.0", "v1.1", "v2.0"]  # Milestone titles or numeric IDs
    max: 3                              # Optional: limit assignments per run
    target: "*"                         # Optional: allow any issue via item_number
    target-repo: "org/other-repo"      # Optional: cross-repo support

JSONL Output Format

AI agents can now use the assign_milestone tool in their MCP server:

{"type": "assign_milestone", "milestone": "v1.0"}
{"type": "assign_milestone", "milestone": "v1.1", "item_number": 42}
{"type": "assign_milestone", "milestone": 5}

Dev Workflow Example

The dev.md workflow demonstrates the functionality:

Lists open issues in the repository
Selects a random issue
Assigns it to the "v0.Later" milestone using the assign_milestone tool

Configuration:

safe-outputs:
  assign-milestone:
    allowed: ["v0.Later"]
    target: "*"
    max: 1

Technical Details - Noop Script Fix

The issue was that noop.cjs has a require("./load_agent_output.cjs") statement, which means it needs to be bundled. However, it was embedded in js.go (for scripts that don't need bundling) instead of scripts.go (for scripts that need bundling).

Changes made:

Removed //go:embed js/noop.cjs from js.go
Added //go:embed js/noop.cjs to scripts.go with noopScriptSource variable
Added bundling variables: noopScript and noopScriptOnce
Added getNoOpScript() function with proper bundler logic
Removed duplicate function from noop.go
Updated tests to include assign_milestone in expected tools

This ensures that when noop.cjs is loaded, all its require() statements are properly inlined by the bundler, preventing the "module not found" error in GitHub Actions.

Key Features

Allowlist-Based Security - Mandatory allowed field with milestone names/IDs
Flexible Configuration - Supports string or array formats
Automatic Resolution - Converts milestone titles to IDs via GitHub API
Case-Insensitive Matching - User-friendly milestone name matching
Target Configuration - Supports triggering issue, explicit numbers, or wildcard
Cross-Repository Support - Can operate on issues in other repos
Staged Mode - Preview changes without making API calls
Comprehensive Validation - Type checking, allowlist enforcement, API validation
MCP Tool Integration - Available as a tool in the safe outputs MCP server

Test Results

JavaScript: 1040/1040 tests passing ✅
Go: All unit tests passing ✅
Workflows: 81 workflows compiled successfully with 0 errors ✅
Code quality: Formatted and linted successfully ✅

The feature is complete, tested, and ready for merge! 🎉

Original prompt

Add a "add-milestone" safe output that allows to add an issues to a milestone.

there is a mandatory allowed list of milestones

infer issue number from context similarly to other issue related safe outputs

front matter allows a string (one allowed milestone), string[] (multiple allowed milestones or object with "allowed" field

allowed: ...

Custom agent used: copilot-add-safe-output-type
Adding a New Safe Output Type to GitHub Agentic Workflows

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

pelikhan · 2025-11-18T14:04:23Z

@copilot rename add-milestone to assign-milestone

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

pelikhan · 2025-11-18T16:20:42Z

@copilot continue work

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-18T16:34:18Z

@copilot continue work

Completed the rename from add-milestone to assign-milestone in commit aadea75.

All files, code references, schemas, tests, and workflows have been updated. The implementation is fully functional with all 1009 tests passing and 80 workflows compiled successfully.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

https://api.github.com/user
- Triggering command: gh api user --jq .login (http block)

If you need me to access, download, or install something from one of these locations, you can either:

Configure Actions setup steps to set up my environment, which run before the firewall is enabled
Add the appropriate URLs or hosts to the custom allowlist in this repository's Copilot coding agent settings (admins only)

pelikhan

@copilot update dev.md to assign a random issue to the "ultimate" milestone on workflow dispatch

pelikhan · 2025-11-18T16:37:42Z

.github/workflows/test-claude-assign-milestone.md

@@ -0,0 +1,24 @@
+---


@copilot move to test workflow folder

Moved to .github/workflows/test-claude-assign-milestone.md in commit 675f964.

pelikhan · 2025-11-18T16:37:58Z

pkg/cli/workflows/test-codex-assign-milestone.md

@@ -0,0 +1,24 @@
+---


@copilot remove file

Removed in commit 675f964.

pelikhan · 2025-11-18T16:38:54Z

pkg/cli/workflows/test-copilot-assign-milestone.md

@@ -0,0 +1,24 @@
+---


@copilot remove file

Removed in commit 675f964.

…copilot tests, update dev.md Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-18T16:51:35Z

@copilot update dev.md to assign a random issue to the "ultimate" milestone on workflow dispatch

Updated dev.md to assign a random issue to the "ultimate" milestone on workflow_dispatch in commit 675f964. The workflow now:

Lists open issues using the GitHub tool
Selects a random issue
Assigns it to the "ultimate" milestone using the assign_milestone safe output

Configuration added:

safe-outputs:
  assign-milestone:
    allowed: ["ultimate"]
    target: "*"
    max: 1

pelikhan · 2025-11-18T16:57:28Z

@copilot make sure assign-milestone tool is added to tools.json and properly configured.

The run https://github.com/githubnext/gh-aw/actions/runs/19474205828/job/55729585359#step:29:1 failed because the tool was missing.

github-actions · 2025-11-18T16:58:11Z

✅ Dev Hawk Report - Success

Workflow Run: #2994

Status: ✅ completed
Conclusion: ✅ success
Branch: copilot/add-milestone-safe-output
Commit: 675f964
Duration: ~1m 41s (16:54:20 → 16:56:01 UTC)
Triggered by: @pelikhan (workflow_dispatch)

The Dev workflow completed successfully! 🎉

All checks passed for the milestone assignment safe output implementation.

AI generated by Dev Hawk

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

pelikhan · 2025-11-18T19:08:11Z

@copilot continue work

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-18T19:13:43Z

@copilot continue work

The assign_milestone tool has been added to safe_outputs_tools.json and workflows have been recompiled in commit 790d752.

The tool is now properly configured and available in the safe outputs MCP server. All tests pass (1009/1009) and both dev.md and test-claude-assign-milestone.md workflows compile successfully.

pelikhan · 2025-11-18T23:43:13Z

@copilot update dev.md to assign a random issue to v0.Later on workflow dispatch

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-18T23:48:07Z

@copilot update dev.md to assign a random issue to v0.Later on workflow dispatch

Updated dev.md to assign random issues to "v0.Later" milestone in commit d09e29e.

The workflow now uses:

safe-outputs:
  assign-milestone:
    allowed: ["v0.Later"]

pelikhan · 2025-11-19T05:16:26Z

@copilot merge main

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-19T05:25:35Z

@copilot merge main

Merged main branch in commit eb9cb4f. Successfully resolved conflicts in:

.github/workflows/dev.md - Kept assign-milestone workflow
pkg/workflow/js/safe_outputs_tools.json - Included both assign_milestone and update_release tools
pkg/workflow/safe_outputs.go - Added UpdateRelease and NoOp support alongside AssignMilestone

All tests passing (1026/1026 JavaScript tests, all Go tests). Dev workflow and test workflows compile successfully.

github-actions · 2025-11-19T05:33:04Z

⚠️ Dev Hawk Report - Failure Analysis

Workflow Run: #3000

Status: failure
Commit: eb9cb4f
Duration: ~2 minutes 17 seconds

Root Cause Analysis

The noop safe output job is failing due to a missing JavaScript module dependency. The job is attempting to load load_agent_output.cjs using a relative path, but the file is not available in the working directory.

Error Details

Error: Cannot find module '/home/runner/work/gh-aw/gh-aw/load_agent_output.cjs'
Require stack:
- /home/runner/work/_actions/actions/github-script/ed597411d8f924073f98dfc5c65a23a2325f34cd/dist/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1420:15)

Key Problem: The script uses:

const { loadAgentOutput } = require("./load_agent_output.cjs");

This relative require expects load_agent_output.cjs to be in the current working directory (/home/runner/work/gh-aw/gh-aw/), but it's not present.

Failure Category

Configuration Error - Missing module dependency/incorrect module resolution path

Recommended Actions

Add checkout step - Ensure the repository is checked out before the noop job runs so that load_agent_output.cjs is available:
```
- uses: actions/checkout@v4
```
Use bundled script - If load_agent_output.cjs is meant to be bundled/embedded in the compiled workflow, verify the bundling process is working correctly
Fix module path - If the module is provided externally, update the require path to the correct location

Investigation Notes

This appears to be a recent issue introduced with the noop safe output implementation. The job successfully downloads the agent_output.json artifact but fails when trying to process it. The noop job doesn't include a checkout step, which means the repository code (including load_agent_output.cjs) is not available in the runner's filesystem.

Similar jobs (like assign_milestone) likely have the same pattern and may need the same fix if they use relative requires without checking out the repository first.

AI generated by Dev Hawk

pelikhan · 2025-11-19T05:38:08Z

@copilot make sure the bundler is applied to the no-op javascript safe output.

See error in https://github.com/githubnext/gh-aw/actions/runs/19490895665/job/55782824497#step:4:1

…iguration Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot · 2025-11-19T05:49:53Z

@copilot make sure the bundler is applied to the no-op javascript safe output.

See error in https://github.com/githubnext/gh-aw/actions/runs/19490895665/job/55782824497#step:4:1

Fixed in commit bb750df. The noop script now has proper bundler configuration in scripts.go, which inlines the load_agent_output.cjs require statement. All tests pass (1040 JavaScript tests, all Go tests) and 81 workflows compile successfully.

github-actions · 2025-11-19T05:55:24Z

✅ Dev Hawk Report - Success

Workflow Run: #3001

Status: completed
Conclusion: success
Commit: bb750df
Branch: copilot/add-milestone-safe-output
Duration: ~1m 45s
Triggered by: @pelikhan via workflow_dispatch

Summary

The Dev workflow completed successfully! 🎉

This run validated the fix for the noop script bundling issue. The commit message indicates:

Fix noop script bundling - add to scripts.go with proper bundler configuration

All tests and compilation steps passed, confirming that the bundler configuration is now working correctly.

Monitored by Dev Hawk 🦅 - Automated workflow analysis for copilot/ branches*

AI generated by Dev Hawk

Copilot AI self-assigned this Nov 18, 2025

Initial plan

86f213e

Copilot AI assigned pelikhan Nov 18, 2025

Copilot started work on behalf of pelikhan November 18, 2025 13:23 View session

Copilot AI and others added 3 commits November 18, 2025 13:42

Add schema, types, and validation for add-milestone safe output

e28d11c

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Add Go implementation and test workflows for add-milestone safe output

0d1061c

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Final validation - add-milestone safe output complete

e0d13c4

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI changed the title ~~[WIP] Add safe output for adding issues to milestones~~ Add add-milestone safe output for assigning issues to milestones Nov 18, 2025

Copilot AI requested a review from pelikhan November 18, 2025 14:03

Copilot finished work on behalf of pelikhan November 18, 2025 14:03

Copilot started work on behalf of pelikhan November 18, 2025 14:05 View session

Changes before error encountered

0faaa5c

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot started work on behalf of pelikhan November 18, 2025 16:21 View session

Complete rename from add-milestone to assign-milestone

aadea75

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI changed the title ~~Add add-milestone safe output for assigning issues to milestones~~ Add assign-milestone safe output for assigning issues to milestones Nov 18, 2025

Copilot finished work on behalf of pelikhan November 18, 2025 16:37

pelikhan reviewed Nov 18, 2025

View reviewed changes

Copilot started work on behalf of pelikhan November 18, 2025 16:43 View session

Move test-claude-assign-milestone to .github/workflows, remove codex/…

675f964

…copilot tests, update dev.md Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot AI requested a review from pelikhan November 18, 2025 16:53

Copilot finished work on behalf of pelikhan November 18, 2025 16:53

Copilot started work on behalf of pelikhan November 18, 2025 16:59 View session

Changes before error encountered

4f5ad59

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot started work on behalf of pelikhan November 18, 2025 19:08 View session

Add assign_milestone to safe_outputs_tools.json and recompile workflows

790d752

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot finished work on behalf of pelikhan November 18, 2025 19:15

Copilot started work on behalf of pelikhan November 18, 2025 23:43 View session

Update dev.md to assign random issue to v0.Later milestone

d09e29e

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot finished work on behalf of pelikhan November 18, 2025 23:49

Copilot started work on behalf of pelikhan November 19, 2025 05:17 View session

Merge main branch into copilot/add-milestone-safe-output

eb9cb4f

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot finished work on behalf of pelikhan November 19, 2025 05:27

Copilot started work on behalf of pelikhan November 19, 2025 05:39 View session

Fix noop script bundling - add to scripts.go with proper bundler conf…

bb750df

…iguration Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>

Copilot finished work on behalf of pelikhan November 19, 2025 05:51

pelikhan closed this Nov 19, 2025

pelikhan deleted the copilot/add-milestone-safe-output branch November 20, 2025 19:14

Conversation

Copilot AI commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Implementation Complete: Assign-Milestone Safe Output

Recent Changes

Configuration

JSONL Output Format

Dev Workflow Example

Technical Details - Noop Script Fix

Key Features

Test Results

Uh oh!

pelikhan commented Nov 18, 2025

Uh oh!

pelikhan commented Nov 18, 2025

Uh oh!

Copilot AI commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

I tried to connect to the following addresses, but was blocked by firewall rules:

Uh oh!

pelikhan left a comment

Choose a reason for hiding this comment

Uh oh!

pelikhan Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

pelikhan Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

pelikhan Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Nov 18, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI commented Nov 18, 2025

Uh oh!

pelikhan commented Nov 18, 2025

Uh oh!

github-actions bot commented Nov 18, 2025

✅ Dev Hawk Report - Success

Uh oh!

pelikhan commented Nov 18, 2025

Uh oh!

Copilot AI commented Nov 18, 2025

Uh oh!

pelikhan commented Nov 18, 2025

Uh oh!

Copilot AI commented Nov 18, 2025

Uh oh!

pelikhan commented Nov 19, 2025

Uh oh!

Copilot AI commented Nov 19, 2025

Uh oh!

github-actions bot commented Nov 19, 2025

⚠️ Dev Hawk Report - Failure Analysis

Root Cause Analysis

Error Details

Failure Category

Recommended Actions

Investigation Notes

Uh oh!

pelikhan commented Nov 19, 2025

Uh oh!

Copilot AI commented Nov 19, 2025

Uh oh!

github-actions bot commented Nov 19, 2025

✅ Dev Hawk Report - Success

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Copilot AI commented Nov 18, 2025 •

edited

Loading

Copilot AI commented Nov 18, 2025 •

edited

Loading